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BACKGROUND OF THE INVENTION 
! Field of the invention 

The present invention relates to en image 
processing apparetus for realign, three-dimensional 
computer graphics and a method of the same, -re 
particularly relates to a configuration of a colter 
g raphics apparatus and method for generating - 

realistic images. 

2 Description of the related art 

A10 „ g with the increase in operation speeds and 
lwt ov«nt of graphic drawing functions in recent 
computer systems, computer graphics <C0, for preparing 

nraDhics and images by using computer 
and processing graphics ana 

k v^n actively researched, developed, and 
resources has been activexy 

put into practical use. 

For example, three-dimensional graphics 
aerates more realistic, three-dimensional -li- two- 
o dimensional high definition images by expressing an 
optical Phenomenon when a three-dimensional object is 
ruminated by a predetermined light source by a 
.athematical model, applying shading or gradation to the 

i i r*nc{ further adhering 
obj ect surface based on this model, and 

2 5 patterns. 



Such computer graphics is now being 
increasingly actively utilized in CAD/CAM in the field of 
development in science, engineering, and manufacture and 
other various fields of applications. 

Three-dimensional graphics is generally 
comprised of a "geometry sub system" positioned at the 
front end and a "raster sub system" positioned at the 
back end . 

The "geometry sub system" is the step for 
performing geometricerations on the location, posture, 
etc. of a three-dimensional object to be displayed on a 

display screen. 

In a geometry sub system, generally an object 
is handled as a mass of a large number of polygons. 
"Coordinate conversion", "clipping", "light source 
computation", and other geometricerations are carried out 

in units of polygons. 

On the other hand, the "raster sub system" is 
the step of painting pixels composing the object. 

Rasterization is realized by interpolating 
image parameters of all pixels included inside a polygon 
based on for example the image parameters found for the 
vertexes of the polygon. 

The "image parameters" referred to here include 
, for example color (generated color) data expressed by the 
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so-called RGB format and z-values for expressing a 
distance in a depth direction. 

Further, in recent high definition three- 
dimensional graphics processing, also an f (fog) for 
5 giving a perspective feeling and a texture t for 
imparting realness by expressing the feeling of a 
ma terial and the pattern of the object surface etc. are 
included as image parameters. 

Here, processing for generating pixels inside a 
10 polygon from vertex information of a polygon is 
frequently executed using a linear interpolation 
technique referred to as a "digital differential 

analyzer" (DDA) . 

in a DDA process, an inclination of the data to 

15 a side direction of the polygon is found from the vertex 
information, the data on the side is calculated by using 
this inclination, and then the inclination in the raster 
scan direction (X-direction) is calculated, and the 
amount of the change of the parameter found from this 
20 inclination is added to the parameter value of the start 
point of the scanning to thereby generate the internal 
pixel . 

in such three-dimensional graphics, in recent 
years, in order to generate more realistic computer 
25 graphic images, the illumination model has been improved. 
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On the other hand, research and development are being 
conducted into the hardware architecture for pursuing 
real time graphic generation performance. 

in general, when trying to improve the realness, 
5 the amount of operations increases and the real time 
property is degraded, while when trying to improve the 
real time property, simplification of the algorithms is 
required and the realness is sacrificed. Research and 
development are being conducted to realize these 
10 conflicting requirements simultaneously as much as 
possible . 

Among the newest hardware technologies for 
pursuing real time graphic drawing performance, there is 
the technology referred to as a "programmable pixel 
15 shader" . 

A programmable pixel shader imparts the 
function of programmability to the step of shading 
performed for every pixel composing a polygon. 

By this programmability, a general reflection 
20 model referred to as a "bi-directional reflection 

distribution function (BRDF) " has started to be mounted, 
and the possibility of the real time, realistic image 
generation has appeared. Further, it has also been 
considered to change the nature of the BRDF so as to 
25 impart change to the color of a polygon surface by 
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texture .napping. Such , BBSF having a different nature 
according to the location on the surface of the polygon 
will be referred to as a "shift-variant BRDF" . 

Below, a detailed explanation will be given of 
. progra-nable pixel shader, BFDF, and shift-variant BKDF. 
Programme 's Pixel Shader 
A programmable pixel shader imparts the 

^ • i • 4-„ i-hfa step of calculation of 
function of programmability to the step 

luminance performed for every pixel . 

The technique of the programmable pixel shader 
is employed in graphic LSIs of GForceS and GForce* of 
NVIDIA Corp. and RADEOH 8500 etc. of ATI Corporation. 

Using this, a user can devise and write a pixel 
shader program to realize a shading model having a 
re alness- not achieveable by conventional fixed hardware 
supporting only gouraud shading in a real time execution 
environment. 

Fo r example, when using not only the techniques 
of gouraud shading, texture mapping, etc. mounted also in 
„ conventional fixed hardware, but also the progranunable 
pixel shader, Phong shading, bump mapping, toon shading, 
environment mapping, etc. can be mounted. Further, an 
anisotropic reflection model and a part of xind BRDF can 
be utilized. 

25 when using a programmable pixel shader, a 



texture memory can be used as a place for storing shading 

parameters mapped on a polygon. 

For example, when there is a shader program 

utilizing a normal direction, the data is stored in the 
normal direction in each texel of the texture memory. At 
the run time, shading can be calculated by using the 
normal obtained from the texel value. Bump mapping and 
partial BRDF have been realized by this method. 

The mechanism of the programmable pixel shader 
of the CForceS and GForce4 of NVIDIA Corp. is shown in 
FIG. 1. 

Basically, this programmable pixel shader is 
configured by a texture lookup unit 1 and an ALU 2 

Four texture addresses TEXO to TEX3 are 
supplied from an upstream programmable vertex shader to 
the texture lookup unit 1. The texture lookup unit 1 can 
look up the texels of four elements of RGBA corresponding 
to four texture addresses at the maximum. The lookup can 
be executed for four elements in parallel. The results of 
the lookup are output to the pixel ALU 2. 

Further, the programmable vertex shader 
supplies four elements of two RGBA to the pixel ALU 2. 
The pixel ALU 2 has special operation units such as 
register combiners 2-1, 2-2, and 2-3 as shown in FIG. 2. 
3 The register combiners 2-1 and 2-2 execute 
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inner multiplication and multiplication, while the 

lister combine, 2-3 executes addition . m the pixel ALU 

a . the data is input to the register combiner 2-1 through 

o /. =r,rJ 2-5 and the data is input to the 
input maps 2-4 and Z a, anu 

register combiner 2-2 through input maps 2-6 and 2-7. By 
this , the multiplication and the inner multiplication can 
b e executed in parallel. Hote that the inner 
notification is only three-dimension x three-dimension. 
The inner multiplication operation can be utilized for 
the inner multiplication of for example the Phong 
reflection model and the diffuse reflection model. 

The pixel shader program is a program of a few 
ste ps which can be defined by the user and executed from 
the header for every pixel. This program controls the 
texture lookup unit 1 and the ALU 2. 



15 

BRDF 



20 



BRDF is a function expressing the ratio of the 
..flection of the light incident upon one point on the 
surface at the object surface. This is expressed as a 
four-dimensional function comprised of directions of the 

iight source and the viewpoint as in the following 

equation : 

1„= BRDF(O i ,(f) i ,0o,<i>o)cos0 i li (1) 
The BRDF can be treated as a higher concept of 
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the conventional wall known shading models. For example, 
the following three lighting effects can be thought of as 
sub sets of BRDF using directions of the viewpoint and 
the light source as the parameters. 

The ambient lighting model is one of the 
lighting effects determined independently from the 
directions of the viewpoint and the light source. 

The diffuse reflection model is one of the 
lighting effects determined according to the direction of 

the light source. 

The specular reflection model is one of the 
lig hting effects determined according to the directions 
of the light source and the viewpoint. 

Other than the above description, a shading 
mod el having anisotropy and a retro reflection model for 
^fleeting the light to the direction of the light source 

etc. can be expressed. 

In order to most simply express also a general 
purpose BRDF, four-dimensional data may be used. However, 
„ when trying to utilize it industrially, the cost of 

realization would be high and therefore this would not be 
realistic. The formats for expression of the BRDF are 
roughly classified into those of a physical equation, 
experiential equation, and approximation equation as 
25 shown below. 



Physical Equation 

This is an equation derived from physical 
principles. The operation is complex in many cases. For 
example, this includes a Torrance-Sparrow model, a Oren- 

Nayar model , etc . 

Experiential Equation 

This is an equation using compact expressions 
for reproducing conspicuous characteristics which can be 
perceived by human beings. Visually definite results are 
obtained. The processing cost is also low. For example, 
this includes a Phong shading model, polynomial texture 
maP s (Tom Malzbender et al . , "Polynomial Texture Maps", 
ComputerGraphics (SIGGAPH2001 Proceedings) , pp. 519-528) , 
a Lafortune-BRDF (E.P.F. Lafortune et al . , "Non-Linear 
Approximation of Reflectance Functions", ComputerGraphics 
(SIGGAPH1997 Proceedings), August 1997), etc. 

Ap proximation Value, A p proximation Equation 
This is an equation using various types of base 
functions and using tabularized data. It is a method 
, considered to compress the data of a four-dimensional 

table provided in a general purpose BRDF . For example, it 
includes a Kauzt-BRDF (J. Kautz et al . , "Interactive 
Rendering with Arbitrary BRDFs using Separable 
Approximations", Proceedings of the 10th Eurographics 
5 Workshop on Rendering, pages 281-292, June 1999) model, 
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Wavelet, BRDF using spherical-harmonics, etc. 

The Lafortune-BRDF model is BRDF defined by 
using a generalized cosine lobe. 

I- P,tC,u x v,+C,u y v T +C«u z vJ" ... (2) 

An anisotropic specular effect, retro 
Election, off specular effect, etc. can be reproduced. 

A polynomial texture map is a shading model 
specializing in its self shadow effect. 

I-a„l^a,lv+a 2 Uv+a3lu+a4lv+a5 ... (3) 

The parameters of the model can be obtained 
fr om a plurality of images captured by using a dedicated 

measurement device. 

A Kauzt-BRDF model is a BRDF model 

„ e : nnal table by multiplication 
approximating a four-dimensxonal tame y 

of two two-dimensional tables by using normalized 
decomposition. There is mounting using the programmable 
5 pixel shader of NVIDIA Corp. The reproducibility of the 
feeling of a metal and plastic is good. However, two 
tables are used, so the required amount of data is large. 
Shift-Variant BRDF 

A BRDF changing according to the location on 

, ^ _ "shift-variant BRDF" 
20 the surface will be referred to as a 

or "BTF" (hereinafter, standardized as "shift-variant 
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BRDF") . A shift-variant BRDF is a six-dimensional 
function. It is also possible to consider as if the two- 
dimensional parameters expressing the location on the 
surface of the polygon were used in the BRDF 

Since there are different BRDFs at different 
iocations on the surface, a material having a nonuniform 
texture can be realistically expressed. For example, this 
is suitable for expressing clothing, fabric, or skin. 

With a programmable pixel shader, by holding 
the parameters of the BRDF model in a circuit similar to 
texture mapping and looking up the parameters, the BRDF 
can be changed in units of pixels. Namely, a shift- 
variant BRDF can be realized. 

For example, the Daubert-BRDF (Katja Daubert et 
al., "Efficient Cloth Modeling and Rendering", in 
Rendering Techniques, '01 Proceedings of the 12th 
Eurographics Workshop on Rendering 2001, Springer Verlag, 
Berlin) experiments with making a shift-variant BRDF of 

the Lafortune-BRDF model. 

However, the Daubert-BRDF only stores the 
parameters of Lafortune-BRDF equations in the texels for 
achieving shift-variance. The coordinate system for 
evaluating Lafortune-BRDF equations is not made shift- 
variant, so bump map-like expressions are not possible. 
25 An effect dependent upon the direction of the viewpoint 
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is rea li,ed * - * - .P. Xn — , U s-^ 

. ^ „ »f feet is not considered at ell . 
th. self shadow effect luminan ce 
A polynomial texture map calculates 

ina . two-dimensional elation comprised of srx 
by using a t-w<~> ^ 

terms as in the above equation 3. 

Thl s technique aims at replacement of 

■nr, A table storing six 
conventional texture mappm, * ^ ^ 

..efficients of the terms m te ^ 
sel f shadow effect is a characterise featur 

Th e pre— A. P^- 1 BRDF ' ^ 

lffer fro m the following 
variant BRDF explained above suffer 

disadvantages however. 

The programmable pixel shader imparts 

, oixel shader - which was 

5 probability to the P ixe ^ 
conventionally a fixed hardware ™t and P 

Ability of a general purpose operation unit 

However, in order not to detract from the 

the sales point of graphics 
operation efficiency - the 

priority has been given to efficiency xn 
20 hardware, priority n 

generalization. 

Th ere are restrictions, however, such as 

fac t that branch commands cannot he used, the lac. of 

,„ in the command set, and the limitation of 
orthogonality m tne u 

25 the data type to 8 bits. 
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The programmable pixel shadar mounted in the 
GFot =e series of HV1D1A Corp. has a circuit configuration 
assuming a shading model enabling calculation by looting 
up texels comprised of four elements from a maximum of 
four texture maps and several inner multiplication 
operations or multiplication operations for every pixel. 

Various shading models can be mounted, but 
there are also shading models with poor mounting 
efficiency or unable to be mounted. Particularly, the 
, processing efficiency of a shading model including many 
matrix operations is poor. Further, only 16 elements can 
be obtained at the maximum from four texture maps. This 
is insufficient for a sufficient supply of matrixes. 

That is, it is necessary to predict a shading 
, m odel which may be utilized in the future as correctly as 
possible and consider the hardware architecture of the 
programmable pixel shader having a good balance between 
efficiency and generality. 

There are diverse forms of expression of a BKDF . 
20 Each has its characteristic features. The application may 
select the form of expression of the BFDF in accordance 

with the objective. 

However, for graphics hardware designed giving 

priority to efficiency and considering the minimum 
25 generalization, desirably the corresponding BRDF model is 
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the minimum and thereby obtains the maxima effect. A 
convenient BRDF model satisfying these contradictory 

requirements is required. 

Further, in order to realize a good shift- 
5 variant BRDF , a high expression power, compact BRDF model 

becomes necessary. 

The form of expression of a BRDF having a small 
number of parameters is suited for a shift-variant BRDF 
When the number of parameters allocated to one texel is 
10 small, the size of the table becomes smaller by that 

amount. Conversely, when the nu^er of the parameters is 
large, the table becomes larger, so a BRDF of a type 
Obtained by coining Kauzt-BRDF or other tables is not 
suited for obtaining a shift-variant BRDF. 
15 SUMMARY OF THE INVENTION 

^ object of the present invention is to provide an 
image processing apparatus suitable for a BRDF operation 
system, able to achieve both a diverse expression power 
end good operation efficiency when mounted in a 
20 progra^able pixel shader, and having a compactness 

~~r,4- a shift-variant BRDF, and 
enabling easily achievement of a shirt 

a method of the same. 

To attain the above object, according to a first 
aspect of the present invention, there is provided an 
25 im age processing apparatus for finding reflectivity based 



on a BRDF model expressing a ratio of reflection of light 
incident upon one point of a surface of an object to be 
drawn at the object surface, having an operation means 
for calculating the reflectivity based on a BRDF model 
calculated by a quadratic-form matrix expression 
including a vector comprised of a light source direction 
vector, a viewpoint direction vector, and a normal 
direction vector and a matrix determining the 
characteristics of the BRDF model. 

According to a second aspect of the present 
invention, there is provided an image processing method 
for finding reflectivity based on a BRDF model expressing 
a ratio of reflection of light incident upon one point of 
a surface of a generated object at the object surface, 
comprising calculating the reflectivity based on a BRDF 
model calculated by a quadratic-form matrix expression 
including a vector comprised of a light source direction 
vector, a viewpoint direction vector, and a normal 
direction vector and a matrix determining the 
characteristics of the BRDF model. 

Preferably, the vector comprised of the light source 
direction, the viewpoint direction, and the normal 
direction is either of a three-dimensional vector 
expressing directions, a quaternion, and a pole 
> coordinate. 
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Alternatively, the vector comprised of the light 
source direction, the viewpoint direction, and the normal 
direction is obtained by regressing the order by using an 
appropriate linear conversion. 

Alternatively, the vector comprised of the light 
source direction, the viewpoint direction, and the normal 
direction is obtained by converting the vector by any 
elementary operation, table reference, or combination of 
the same . 

Alternatively, the matrix determining the 
characteristics of the BRDF model calculated by the 
quadratic-form matrix expression is divided into sub 
ma trixes and operation is performed for evaluation using 
a polynomial comprised of a quadratic form of the divided 

sub matrixes . 

Alternatively, the quadratic form is calculated by 
the procedure of multiplying the matrix and vectors, then 
multiplying the vectors with each other. 

Alternatively, evaluation results of one or more of 
, the BRDF models are combined by selectively using 
addition/subtraction, multiplication, division, 
cumulative multiplication, and the quadratic form. 

Alternatively, the BRDF model is calculated by a 
composite operator having two operation modes of a matrix 
5 operation equation comprised of two different vectors and 
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a s\om of the quadratic-form matrix including a triangle 
matrix and vector multiplication. 

Alternatively, the matrix determining the 
characteristics of the BRDF model is given by using a 
5 texture map. 

Alternatively, elements of the matrix determining 
the characteristics of the BRDF model are interpolated 
based on MIPMAP processing including predetermined 
filtering . 

10 Alternatively, the matrix determining the 

characteristics of the BRDF model is referred to from an 
i ndexed tabl e . 

Alternatively, the matrix determining the 
characteristics of the BRDF model is obtained by solving 
15 an equation comprised of a plurality of polynomials 

obtained by entering a plurality of BRDF raw data given 
in advance into the BRDF model . 

Alternatively, the matrix determining the 
characteristics of the BRDF model is formed from the 
2 0 parameters of a polynomial texture map by a 

correspondence obtained by assuming that a diffuse 
reflectivity distribution corresponding to the light 
source direction is the same as a specular reflectivity 
distribution corresponding to a half vector direction. 
25 That is, according to the present invention, for 
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examp le the operation calculates the reflectivity 

b ese d on a BRDF model calculate, by a 

..trix exp.e3s.on including a vector ^ of a light 
source direction vector, a viewpoint faction vector, 
a nd e ^ — sector and a matrix determining 
the characteristics of the BRDF model. 

BRIEF DESCRIPTION OF THE DRAWINGS 
The above an d other objects an d features of the 
pr esent invention will be more apparent fro, the 

• n„n of the preferred embodiments given 
following description of tne p 

in relation to the attached drawings, wherein: 

PIG. 1 is a view for explaining a mechanism of a 
conventional programmable pixel shaoer; 

PIG. 2 is a view of the concrete configuration of a 

5 pixel ALU of FIG. 1; 

„0 3 is a block diagram of an embodiment of an 
image processing apparatus according to the present 
invention ; 

PIG. 4 is a bloc, diagram of a concrete example of 
20 the configuration of a GPU of FIG. 3; 

PIG. 5 is a view of an example of the configuration 
o£ . logical blocx constructed by a program stored in a 
computer according to the present embodiment; 

PIG. 6 is a flow chart for explaining an example of 
25 the operation using an image combiner; 



FIG. 7 is a flow chart for explaining the detailed 
routine for one-path drawing at step ST3 of FIG. 6; 

FIG. 8 is a view for explaining a method for 
handling a BRDF having an expression hard to reproduce by 
5 a single BRDF of the present invention; 

FIG. 9 is a view for explaining a preferred example 
of operators for efficiently performing processing for 
evaluation of a BRDF of the present invention; 

FIG. 10 is a view of an example of an operation 
10 circuit for realizing FIG. 9; 

FIG. 11 is a view for explaining an example of 
forming a texture map having a matrix M as texels, 
looking up the matrix M from the texture map at the time 
of execution, and using this as the parameter of the BRDF 
15 of the present invention; 

FIG. 12 is a view of the configuration of a logical 
circuit using an index map; 

FIG. 13 is a view for explaining a method of 
calculation of parameters of a BRDF of the present 
2 0 invention; 

FIG. 14 is a view for explaining an assumption that 
a diffuse reflectivity distribution corresponding to a 
light source direction and a specular reflectivity 
distribution corresponding to a half vector direction are 
2 5 the same; 
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FIG. 15 is a view of an example of a configuration 
realizing a function of a first mode of FIG. 9 by using a 
register combiner of FIG. 2; and 

FIG. 16 is a view of an example of a configuration 
realizing a function of a second mode of FIG. 9 by using 
the register combiner of FIG. 2. 

• DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Below, a detailed explanation will be given of 
embodiments of the present invention in relation to the 
drawings . 

in the embodiments, first the configuration and 
functions of an image processing apparatus employing BRDF 
m odel evaluation operation according to the present 
invention will be explained, then the BRDF model 
according to the present invention and the operation for 
evaluation of it will be explained in detail. 

FIG. 3 is a block diagram of an embodiment of the 
image processing apparatus according to the present 
invention . 

The image processing apparatus 10 has, as shown in 
PIG. 3, an input devioe 11, a display 12, a network 13, 

and a computer 14 . 

The input device 11 includes an input device such as 
a keyboard, a mouse, and a Joystick and is used by the 
25 user for instructing the computer 12 and inputting 
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information . 

The display 12 is configured by an image display 
de vice such as a cathode ray tube (CRT, or liquid crystal 
display (KD> and displays an image in accordance with 
the image data generated at the computer 14 . 

The network 13 is comprised of a U». the Internet, 
or other large number of computers connected to each 
ether. The computer 14 transfers data with the outside 

via the network 13. 

The computer 14 has, as shown in PIG. 3, a CPU 141, 
a memory 142, a bridge unit 143, an external input/output 
unit 144, an external storage 145, a U. device 146, a 
frame buffer 147 and a graphics processor unit 
(hereinafter, referred to as a GPU) 148. 

The CPU 141 controls the entire computer according 
to a program stored in the memory 142 . 

The memory 142 is a memory device such as a DRAM or 
. SRft M for reading and writing of data by the CPU 141 at 
a high speed and stores programs and data. 

The bridge unit 143 is a connection circuit enabling 
the CPU 141 and the GPU 148 to transfer data with the 
memory 142 and the external input/output unit 144. 

The external input/output unit 144 is an interface 
for transfer of data with the input device 11 and the 
25 external storage 145 and has a USB interface, an IDE 
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interface, a PCI interface, etc. 

The external storage 145 is a large capacity storage 
device for storing programs and data such as a hard disk 
drive, a CDROM drive, an MO drive, and a memory card. 

The LAN device 146 is an interface for connecting an 
external network and the computer 14. For example, the 
LAN device 146 includes a modem, an Ethernet (registered 
trademark) device, etc. 

The frame buffer unit 147 has a high speed memory 
for enabling the GPU 148 to temporarily store image and 
other data . 

The GPU 148 is a device supporting high speed 
operation of computer graphics. Further, the GPU 148 also 
works to output image data drawn in the frame buffer unit 
147 to the external display device 142. 

FIG. 4 is a block diagram of a concrete example of 
the configuration of the GPU 148 of FIG. 3. 

This GPU 148 has, as shown in FIG. 4, a processor 
1481, a RAMDAC 1482, an inter-connect unit 1483, a work 
memory 1484, and an arithmetic operation unit 1485. 

The processor 1481 performs rendering according to 
the routine received from the CPU 141. 

The RAMDAC 14 82 converts the image data stored in 
the frame buffer unit 147 from digital data to analog 
5 data for displaying the same on the display 12 and 
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. af r*- er the conversion to the 
outputs the analog data after the 

display 12. 

Th e inter-connect unit 1483 is e ccnnect.cn crrcult 
for the of data between the internal portion - 

1481 RAHDAC 1482, work memory 
5 the GPU 148 (processor 1481, 

1485) and external blocks 
!484 , and arithmetic operator 1485) 

(f rame buffer 147 and bridge unit 143) . 

Th e work memory 1484 is a memory used by the 
cesser 1481 and the arithmetic operation unit 148S and 
„ stores programs and the temporary calculation results. 

Th e arithmetic operation unit 1485 has operate 

lAfll to efficiently perforin 
units enabling the processor 1481 

f a BRDF and mounts a composite 
operation for evaluation of a BRDF 

operator etc. 

T he computer 14 having the above configuration uses 
. program stored inside the computer 14 to, ror example, 
as sh own in no. 5, construct inside the computer 14, 

configuration. 

Th is logical block 200 is roughly configured by 

• ptc; 5 that is, is configured 
three stages as shown in FIG. 5, th 

., , m an image composition 
by a geometric operation unit 201, 

uni t 202, and a pixel operation unit 203. 

4 4- includes, as shown 

The geometric operation unit 201 xne 

„ nit 2011, a camera coordinate 
25 in FIG. 3, an application unit 2011, 
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■ t 2012 a perspective transformation unit 
conversion unit 2012, a P 

^ = rasterization unit 2014. 
2013, and a raster a 

in£oI mation processing according to op—™! 

- M.vice 11, generates a scene 
information from the input device 

• sed of a Plurality of polygons, and outputs 
graph comprised of a P 

to the camera coordinate conversion unit 2012 
the same to tne 

and the image composition unit 202. 

nnih 2012 converts 
Th e camera coordinate conversion unrt 

^ a coordinate system 
the coordinates of the polygons to 

F „ virtual camera and cutputs 
b ssed on the coordinates of a 

the same to the perspective transformation unrt • 
T he perspective transformation unit 2013 projects 

. ^ - two-dimensional 
th . TO crdinates of the polygons to 

f *- he virtual camera. 

- p^— — breaks doun ea ch polygon 

The rasterization unit 2014 
to piX els matching with the resolution characteristic of 

operation unit 203. ^ ^ ^ 

The image composition unit 

DU ffer 2021 and an image composition 
FIG. 5, an image buffer ^ 

ooeration unit 2022. 

• e buffer 2021 is a memory used for storing 

The image butter 
and hclding images generally referred to as a frame 
25 bu ffer and temporarily holds the data of the operate 
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results of the image composition — — 

« data - - - - — ^ 

Th e iira ge composition operation unit 

oh as weighted composition of images 

— j stored in the image b uff.r 

with respect to tne image data 

1. refer to Foley, COMPUTER GRAPHICS 
2021 (for example refer 

Section 17 . b . 

principles and practice, PP- 835, 

Compositing) . lighting 
The Pixel operation unit 203 performs 

. £o r each pixel based on the information 

. . t the rasterization unit 2010 y 
prepared at tne a smaller unit than that 

executed for every pixel, i.e., 

of a polygon. . n 

5 a BRDF operation unit 2031, a looxup unit 2032, 
" G it 2033 a scale operation unit 203*, 

power operation unrt 2033, 

"* * teXtUrS 2035 ' . t 2031 evaluates and processes 

The BRDF operation unrt 2031 

<■„ the present invention defined 
20 the BRDF model accordrn, to P 

u sing the q uadratic-form mentioned in detail 

follows: 
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... (4) 

Here. L and V indicate vectors representing the 
sections of the 11*.* source end the viewpoint input 
from the rasterisation unit 2.14. « -dicates a vector or 
(0 , 0, X. representing the direction or the normal. M 
ind ioates a parameter represents the nature o, the BP.P 
eeoordin, to the present invention input - the lookup 
unit 2032. 

*- s of the sub matrix are 0, the value 
When all elements of tne 

- will clearly become 0. At that time, the 
of the term will ciean^ 

operations for that term can be omitted. 

Fur ther, when a composition operation unit is used, 

^V, CIM^UW*. - ^ - ^ C ° mPUted " 

abou t the same cost. Due to this, improvement of the 

r utilization of hardware resources is 
5 efficiency of utilizacioi 

achieved. 

Th e looKup unit 2032 loors up the paremeters 



corresponding to the pixels from the texture map 2035 
according to addresses input from the rasterization unit 
2014. The obtained parameters are used as parameters of 
the function operations to be performed at the BRDF 
operation unit 2031, the power operation unit 2033, and 
the scale operation unit 2034 . 

In the present embodiment, as will be explained in 
detail later, in order to handle a BRDF having an 
expression hard to reproduced by a single BRDF according 
to the present invention, the evaluation value of the 
BRDF operation unit 2031 is changed at the power 
operation unit 2033 and the scale operation unit 2034. 

The power operation unit 2033 cumulatively 
multiplies the evaluation values input from the BRDF 
operation unit 2031 as in the following equation: 

Power =quadBRDF<^ ossiness) ... (5) 

The scale operation unit 2034 performs an operation 
for multiplying a value "Power" input from the power 
operation unit 2033, an intensity "Lightlntensity" of the 
light source input from the rasterizer 2014, and a 
) reflectivity "Reflectivity" for each of RGB input from 
the lookup unit 2032 as in the following equation: 
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RcsulllntensityR — RefledivityR • r 
S ",,= Re<«««ivi,, B • L, g h,.n,s»si., B • Power 



. (6) 



The scale operation unit 2034 writes the 
,. Res ultIntensit Y » obtained based on elation 6 into the 

image buffer 2021. 

Th e deta written in the image buffer 2021 is 
combined by the image composition at the image 
composition operation unit 2022. By this processing, one 
polygon is generated a plurality of times while changing 
the shading parameter by multi-path rendering and the 

results are combined to obtain the intended shading 

result image. 

Next, an explanation will be given of an example of 
the operation when an image composition unit is utilized 
in relation to the flow charts of FIG. 6 and FIG. 7. 

Utilizing the image composition unit of the present 
embodiment and the technigue generally referred to as 
multi-path rendering, one polygon is rendered a plurality 
of times and the rendered results are combined in 
accordance with the image compositing technigue to draw 

0 one polY9 on ' 

This routine will be explained by referring to the 

flow chart of FIG. 6. 
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" . is carried out. For example, the 

th. multi-path renders - 

da ta or the image hurrer »here the poison rs he 

t ed is erased and an image graph — «" 
generation routine and - oontents is set. 

t-vV> is traversed and the 

At step ST2 , the image graph rs 

f one path is set up. 
graphic drawing of one p 

Ste^ P ST3^0n^_Path_Dr S ^ 

2£SE — ^ ■ t 201 and 

¥ ST3 the geometric operate unit 
At step ST3, th g Qf 
„nit 203 generate one path s w 
the pixel operation unit 

in the pres ; ge 

. ,» «r the required image 
t-^r, are combined or the r h 
or the previous step are 

processing is carried out. 

TMdame ntofMuJ^ 
Step ST52_Judgmervc_ji 

^ od if all paths' worth of the 

At step ST5, it is judged if 

le , ed m the multi-path 
drawing were completed. 
20 graphics drawi g proce ssing 

^ if in the middle, f 
completion judgment, 

the processing from step ST2 
routine returns to the P contin ued 

" lt i- P ath rendering is rinallv —ted. 

until the „ultr pat ^ routine 

in the above routine, the 
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drawing of one path's worth of graphics at step ST3 
becomes as shown in FIG. 5. 

Ste p STll: C amera Coordinate Conversion 
First, at step STll, the polygons of the model 
coordinate system are converted to the camera coordinate 
system by the camera coordinate conversion unit 2012. 
Ste p. ST12: Pers pective Transformation 
At step ST12, the polygons are projected to the 
screen coordinates by the perspective transformation unit 
2013. 

cti^ ; initial ^^ion of Interpolation 

Parameters 

At step ST13, the rasterization unit 2014 initially 
sets the texture address, the light source direction, the 
, viewpoint direction, and other values found by 
interpolation for pixels inside a polygon. 

ST14: interpola tion of Interpolation Parameters , 
Next, at step ST14 , the rasterization unit 2014 
finds the texture address, the light source direction, 
o the viewpoint direction, etc. by interpolation for every 
pixel . 

xt& p ST15 : Texture L ook Up 

At step ST15, the lookup unit 2032 looks up the 
value of the texels from the texture data according to 
25 the texture address. 
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t on to evaluate the — — — — 
performs operation to 

to the present Invention. 

At step ST17, the power operator 2033 

■ a »t the previous step ST16 to 
evaluation result obtarned at 

the power. 

S^3I^^^ . „ nit 2034 scales 
At step ST1S, the scale operate unrt 

a =>t the previous step ST17. 
th e result obtained at the P 

S£SE 7^ T^Tr^sTtained at the prevrous 
At step ST19, 
tDST16 _ written into the image buffer 2021. 

, dument^fComoletio^^^ 
, t . r ST20t T^T-ant or 

t o ST20 it is judged whether or not the 
At step ST^u, 4 

, f«i The processing from step ST14 
. as terization is completed. The p 

rasten^ drawn. 
is repeated until all P-ls in all 

„ ext , . detailed explanation will ~ given of * 

operation for evaluation of it. 

using Quadratic Form 
g ffiF j2odelinaJJsin2_Ji 

„f the BRDF is modeled as 
In the present embodiment, 

na the quadratic form .hereinafter this 
follows by using the q 

. ,.„ the "BRDF model of the 
25 mod el will be referred to as 
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present invention") . 
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quadBRDF(L,V,N;M) = 
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M 22 


M, 2 


V 
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M 33 . 


N 



(7) 
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15 



Here, the matrix M is a parameter for determining 
the characteristics of the BRDF model of the present 
invention. Due to the nature of the equation, any M can 
be simplified to a symmetric matrix or a triangle matrix. 
Further, L indicates the vector representing the light 
source direction in a surface coordinate system. V 

indicates the vector representing the viewpoint direction 

in the surface coordinate system. N indicates the vector 

representing the normal direction in the surface 

coordinate system. 

The BRDF model of the present invention uses a 

vector [LVN] comprised of arranging the above L, V, and N. 
For example, each L, V, N may be a three-dimensional 

unit vector representing the direction of each. This can 

be concretely written as follows: 
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quadBRDF(L,V,N;M) 
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... (8) 

v. t v and N may be a vector 
Further, each L, V, ana n mciy 

represented by .sin, other vector space too. For example, 
it is also possible to use a general coordinate system 
such as a pole coordinate system or ^aternion. It is 
al so possible to use another speoial coordinate system. 

F urther, it is also possible to repress the order 
using an appropriate linear conversion. Other than this, 
it is possible to use any elementary processing or table 
Terence or combination of the same to convert these 
vectors. In the following example, use is made of a model 
gained by releasing I* and V of the three-dimensional 
vector to two dimensions and a model obtained by 
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converting M to the constant 1 . 



ti- 



quad(L,V,N;M)- 



•y 



m „ m, 2 m M m, 5 m, 9 irLx| 

0 m n m 2 4 m 2 s n^llLyl 

0 o 0 m 55 m59 \ 1 Vy 

0 0 0 0 m "\\ 1 



. (9) 



DetajJjLJ>f_CaJ^ 

1B the BRDF model of the present invention, it is 
also possible to divide the matrix representing the 

, ma . ri5[SS as follows and 
parameters of the model into sub matrixes 

, Bfl for evaluation using a polynomial 
perform the processing for 

comprised of these sub matrixes. 
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If the sub matrix M nn is a zero matrix, the value of 
the term thereof clearly becomes 0. That is, the 

- that term can be omitted. In actual 
calculation of that term 

efficient to mount just the required 
mounting, it is more efficient 

terms . 

„ the next matrix expression, if csicuXsted as 
foll o«s, the ^ - ^e retired -nuitipUers can he 
reduced . 
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L M 21 V= L, U24 m 2S mj V y 
L z J[m 3 4 m 35 mjej^ 
= U (m 14 V x +m 15 V y+ m 16 V t ) + Ly (mzV^+m^Vy+m^V,) 
+ Lr(ni34Vx+in35Vy+m M V«) 

... (ID 

After multiplication of the matrix and the vectors, 
calculation is possible by the routine of multiplying the 
vectors. This results in 12 multiplication operations and 
eight addition operations. 

On the other hand, the equation can also become a 
format expanding the terms as follows. In this case, IB 
multiplication operations and eight addition operations 
become necessary. 

LM 21 V = m 14 L,V x+ m 15 UV y + «^V B + m 25 LyV y+ 

+ m 3 4LzV x + m 35 UV y + m 36 UV z 

... (12) 

As a result, it is more efficient to perform the 
calculation by the former (equation 11) method. 

As described above, the BRDF of the present 
invention is comprised of only product-sum operations. 
Further, since this is an equation comprised of vectors 
and a matrix, efficient processing is possible. 

Shadin g Effect of BRDF of Present Invention 
The shading effect of the BRDF of the present 
invention is determined according to the parameters M. 
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i-he correspondence 

Below, an explanation .ill be g-en of 

, he shadin g effect and the parameters, 
between the shading M is a sub 

va 4« a zero matrix. M„ n is a s 
0 in the parameters M is a ze 

• »t least one element is not 0. 
matrix wherein at least 

„ ffDr t-n is an effect 
The "ambient lighting effect 

„ t of the light source direction and the 
independent of the 9 ~ oot « is 

• t direction. The "diffuse reflection effect 
viewpoint directi ^ 

an effect dependent upon the light 

• , direction. The "specular 
^dependent from the viewpoint direct 

effect" is an effect dependent upon the Hg 
reflection etrect 

• direction. Each can be 
,r,ri the viewpoint direcum 
source direction and the wp ^ 

„trl-. not «™ -t.1— - 



... (13) 
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(14) 
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M = 



0 M« 0 
0 0 0 

ooo 



(15) 



. „t- Effect Parameter 
I i i 3 ht^ource_Dire^^ 



M = 



M,i 0 M 3) 

ooo 

0 0 0 



. . (16) 



vi 2 w E oint J ;irect^ 



M = 



ooo 

0 Un M« 
0 0 0 



(17) 



Tot alEffect P arameter 



M = 



M n Mjt Mj, 
0 M22 Mm 
0 0 M33 



(18) 
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CorresEondenceJ^^ 

r tk . oresent invention has effects 
The BRDF of the present 

t .„„ allv we ll known shading models, 
including the conventionally wel 

Below, a description will be given of the 
corre spondence between the expressions of the 
conventional models and details of the parameters rn 
BRDF of the present invention. 
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M = 



ooo 

0 0 0 
0 0 M J3 



(where M33 : 




(19) 



Diffuse^ef^ction^^ 
0 0 M31 

(where M31 — I 0 



M = 



0 
0 
0 



0 M31 

0 0 
0 0 




. (20) 



^.^^^^ vacation 
resul ts of BRDF « P-ant invanUon to n-th 

n-th power of Phong model) 
matching with n tn po 



M = 



0 M 2) 0 
0 0 0 

0 0 0 



(where M21 — 



-k s 0 0 
0 -k, 0 
0 0 k s 



(21) 



Tr ^rMme-BRDF 

,„. (raise evaluation result 

Q^SC^^^d^^^^- (ralSe 

t-o n-th power and multiply 
of BRDF of present invention to n tn P 

^ ^ multiplication of 
bY p. etching with n-th power and pa 

Lafortune-BRDF) . 



10 



M = 



0 M21 0 

0 0 0 
000 



(where M21 — 



c x 0 0 
0 c y 0 
0 0 c z 



) 



.. (22) 



10 p^c^ial Texture Map 
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M = 




a 2 0 



(where M n = | 0 a, 
0 0 



0 
0 



,M 3 « = 





... (23) 

fho brd f of the present 
i f usina the etu^r « 
As described above, if usxng 

w <- 0 realize a model equivalent 
<-^n it is possible to reanz 
invention, ^ 

to conventional shading models by 

^heir effects. Further, it is 
peters - d to express . 

als o possible to .-.est — - — V 
Unnecessary 

oint direction dependent effect is 
When a viewpoint aire 

the BRDF of the present invention can be 
unnecessary, the BRDfc 

modified as follows: 



qU adBRDF(L,V,N;M) - \^\[ Q Q M}J J 



L 
V 



. (24) 



Th e above e,„a ti0n inches at least tbe e«ects 
abl e to be expressed by the two -oaels of the 
15 . BRDF ana polynomial texture maps 

conventional Latortone-BRDF 
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^ ta Lafortune-BRDF, and M», 
The fact that M 21 corresponds to 

eDond to polynomial texture maps was 
M31 , and M 33 correspond to p 

the parameter matrix M 
Kofore It is seen that tne p 
explained before. 

^ set of sub matrixes of these 
stands from the sec o 

In add ition, sub matrixes -responding - 

, it be considered that the effects are 

Th ere f ore. ^ BRDF 

ind ependent from each othe 

of the present invention has at 

ffects possessed by the polynomial texture 
complementary effects pos 

rap s and the - ~ 

enabling independent controi of these effects. ^ 
M _ 2£ hod M ino-h^^ 

„ bv sincieBRgjiof_jai^^ 

For a BRDF having an expr Qssibleto 
. singl e BRDF of the present invents, 
c _e the evasion results of one or mor 
the present invention by various operations 

tended BRDF. ^ ^ ^ ^ 

For example , a tree 1 
2 ► ™ »s the terminal nodes 

the BFDFs of the present invention as th 

• FIG 8, using various operation units 

the 

0P1 to OP3 as intermediate nodes, and the outp 

■ sed as the value of the intended BRDF. For 
root node is used as tne 

• units OP1 to OP3, addition/subtraction, 
25 the operation units OP J. 



^Implication, division, cumulative multiplication, 
qu adratic-form, and other operation units are seiectively 
used* 

For example, when desiring to control the 
directivity of specular reflection used in Phong shading 
and L afortune-BFI,F, the evaluation result of the BFDF of 
the present invention may be raised to the »- power (or 
raised to the n-th power) as follows: 

1 = a • (quadBRDF(L,V)) wn ... (25) 

When desiring to more clearly bring out the self 
„ shadow or view dependent effect, it is possible to 

multiply the evaluation results of BRDF models of the 
present invention having different parameters as follows: 
1 - q »adBRDF(UV,N;M,) • q U .dBRDF(L,V,N;M ! ) (26) 

Further, it is also possible to use the 22nd order 
1S format matrix operator used in the evaluation of the BRDF 
model of the present invention. As shown in the following 
nation, it is also possible to combine the evaluation 
results of different BFDF models of the present invention. 
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BRDFi(quadBRDF 2 • quadBRDF 3 ) 



quadBRDF 2 


k„ 


k 2 i 




quadBRDF 2 


quadBRDF 3 
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k 22 


k 32 


quadBRDF 3 
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0 


k 33 


1 



(27) 



Here, quadBRDF 2 and quadBRDF 3 indicate the 
evaluation results of different BRDF models of the 
present invention, and BRDF, indicates the combined 

result thereof. 

Simultaneous Ca lculation of Triangle Matrix and 

Matrix 

in order to efficiently perform the operation for 
evaluation of the BRDF of the present invention, as 
already explained, it is possible to use a format 
10 breaking down the BRDF of the present invention into a 

plurality of terms comprised of sub matrixes as follows. 

quadBRDF(L,V,N;M) = 

LM„L + VM 22 V + LM 21 V + LM 31 N + VM 32 N + NM 33 N (28) 
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Among these, LM 21 V, (LM11L+LM31N) , and (VM 22 V + VM 32N ) 
can be calculated by a combination of the same amount of 
operation units. Therefore, when forming a composition 
operation unit able to selectively perform these three 
types of operation, the mount efficiency is good. 

Let us look at the above three types of operations 

in detail . 
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First, the matrix operation LM 21 V comprised of the 
following two different vectors is comprised of 12 
m ulti P lication operations and eight addition operations 

LM21V = 



10 
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"u 


m 14 


mis 










1H24 




n^26 1 


R 
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0134 


m 35 


m36j 





+ U(n»34Vx+ni35Vy+m36Vz) 



(29) 



Next, a sum <LM llL+ LM 31 N) of the quadratic- form 
matrix and vector multiplication comprised of the next 
triangle matrix becomes an operation comprised of 12 
multiplication operations and eight addition operations 
obtained by adding two terms comprised of nine 
multiplication operations and five addition operations 
and three multiplication operations and two addition 
operations : 
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LMiiL-*-LM 3 iN 
! ~* ir m M m, 2 mi 3 "irLx 
0 m 2 2 0123 jLy 
m 3 3 L z 



U 
L, 




0 0 
Ul[mn m 12 0 "llL, 
Ly 0 m 22 m u JLy 

- {UCmnU+m^Ly) + Ly(m 22 Ly+m 23 L I ) + Ui^U^U)} 
+ {mi9L x +ni29Ly , ' m 39Li} 



It1|9 

m 29 
m J9 



. (30) 



Further, (VM 22 V+VM 32 N) is comprised of 12 
xnultiplication operations and eight addition operations 
in the same way as the above. 

That is, three types of operations, that is, L** 21 V, 
(LM11L+LM31N) , and (VM 22 V + VM 32 N) , may be carried out by the 
composition operation units COPl and COP2 as shown in FIG. 
9 having a first mode and second mode using combinations 
of the same amount of operation units by selecting either 
one from among these three types. 

FIG. 10 is a view of an example of the operation 
circuit for realizing FIG. 9. 

This operation circuit 300 is configured by, as 
shown in FIG. 10, connecting the multipliers 301 to 311, 
the adders 312 to 317, and the registers 318 to 322 in a 
15 tree- 

This operation circuit 300 can operate in a first 
mode and a second mode. 
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in the first mode, it performs an operation by a 
circuit configuration excluding the adders 313 and 317 
and the registers 318, 320, and 322. 

in the second mode, it performs an operation by a 
circuit configuration excluding the output of the 
multiplier 304 to the adder 314, the output of the 
multiplier 308 to the adder 315, and the register 321. 

in this way, the operation circuit 300 can realize 
the operations of the first mode and the second mode 
using the same operation circuit by just changing part of 
the interconnects. 

Shift-Variant BRDF 

As shown in FIG. 11, a texture map is formed using 
the matrix M as the texels . At the time of execution, the 
matrix M is looked up from the texture map and used as a 
parameter of the BRDF of the present invention. 

in this case, the matrix M is supplied from a 
texture map 402 to a BRDF evaluation operation unit 401, 
while the vectors L, V, and H are supplied from an 
interpolator 403. Then, the operation result of the BRDF 
evaluation operation unit 401 is stored in a frame buffer 
404 . 

For the sampling problem of the texture map 
generated due to the scaling of the surface to be drawn 
5 with respect to the view coordinate system, the 



parameters of the BRDF of the present invention may be 
converted to a MIPMAP (plurality of resolution textures) 
in the same way as the conventional method. 

The following equation indicates that when a 
parameter mn-99 is sampled n times for a patch ft on the 
surface, the value obtained by averaging the BRDF of the 
present invention calculated for the patch region and the 
result of calculation of the BRDF of the present 
invention using the parameters averaged for the same 
patch region are equal . 

-i- J2 quadBRDF(m HJ ^ii,,v,)) = quadBRDF(i- J^m^Ui.v,)) 

... (31) 

That is, by using the conventional MIPMAP and bi- 
linear and tri-linear filtering, the above sampling 
problem can be solved. 

Method for Acquiring Parameters and Calculating 
Power Utilizing Index Map 

It may also be considered to use the index colors 
which have been used in conventional texture mapping to 
obtain a table indexing parameters of the BRDF model of 
the present invention and a conversion table for 
calculating the power and refer to this. 

FIG. 12 is a view of the configuration of a logical 
circuit using an index map. FIG. 12 shows the logical 



block 200 of FIG. 5 explained in the above concrete 
embodiment but made more generalized in configuration. 

In FIG. 12, 500 indicates an index map, 501 a 
rasterization unit, 502 a lookup unit, 503 a parameter 
list, 504 a BRDF operation unit, 505 a power list, 506 a 
power processing unit, and 507 a scale processing unit. 

An index corresponding to a location on the surface 
of a generated object is looked up from the index map 500 
by the lookup unit 502 to obtain the parameters and power 
list corresponding to that index. The obtained parameters 
are used for calculation of the BRDF of the present 
invention. The power value of the evaluation result of 
the BRDF of the present invention is obtained by 
referring to a value corresponding to the evaluation 
result from the power list and performing appropriate 
interpolation. The result becomes the intended power 
value . 

Method of Calculation of Parameters of BRDF of 
Present Invention 

As shown in FIG. 13, the parameters used in the BRDF 
of the present invention can be obtained from BRDF raw 
data obtained by observing the characteristics of 
clothing, skin, or other material in the real world by a 
special device or BRDF raw data obtained as a result of 
calculation of the reflection characteristics of these 



materials by simulation. 

Below, an explanation will be given of a method of 
finding the parameters to be used in the BRDF of the 
present invention from the BRDF raw data. 

When a reflectivity r (k) of raw BRDF data 
corresponding to the light source direction L(k > and the 
viewpoint direction V« is known, the parameter M is 
applied to the BRDF model of the present invention as an 
unknown number . 



N 



0 Mn M 32 

0 0 M} 3 



L ( v) 

Ln 



. (32) 



0 if developing this equation, the following 

polynomial is obtained. 



r, k , = <niiw ( nii + m, 2 w (kM 2+- + m 9 9W< k) .99 



(33) 
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-i = multiplier corresponding to the 

Here, w (k) ,11-99 is tne muitiF^= 

unknown number mn-99 obtained from L (k) , V w , and N. 

When there are n number of sets of observation data, 
n number of equations comprised of the above equations 
are obtained. If a coefficient mn-99 satisfying these n 
number of equations best is found, the parameter M can be 
found . 

in order to find this, it is possible to use least 
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square approximation so as to make the average of the 
squares of the difference between values of the two sides 
of the above equation as small as possible. 

„, ^ ^ Q , mr i v seating gBgcular Component from 
Pol ynomial Texture Map Parameters 

The effect of the specular component which can be 
used in the BRDF of the present invention can be simply 
created from polynomial texture map parameters. 

First, assume that the following two distributions 
are the same (refer to FIG. 14) . 

Namely, there are a diffuse reflectivity 
distribution corresponding to the light source direction 
and a specular reflectivity distribution corresponding to 
the half vector direction. 

From this assumption, the effect of the specular 
component can be created by the following equation: 

1= PTM(L)+k'PTM(H) n ... (34) 

Here, PTM is the evaluation formula of the 
polynomial texture map model. 

The second term on the right side of the above 
equation can be written in more detail as follows: 
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PTM(H; a« a,) 

' r H«irao a 2 
0 
0 




U+V,/2 a, a 2 
Ly+Vy/2 0 a, 
I JLo 0 




. (35) 



„ h en insertin, this Ration in the parameter matrix 
of the BBDF of the present invention, the resuit is as 
follows: 



PTM(H; a 0 . .a 5 ) 

= q uadBRDFpTM(H)(L,V,N;ao...a 5 ) 

i0 /4 a 2 /4 0 a 0 /2 a 2 /4 0 
a ,/4 o a 2 /4 a ' /2 0 

oooo 
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With the above as it is, the effect is the same as 
giving a half vector to the polynomial texture map. 

However, if giving appropriate change to the 
parameters by utilizing a pseudo normal direction or the 



like obtained from the above parameters, anistropy or 
another effect may be obtained. The BRDF model of the 
present invention is advantageous for future expanded 
effects . 

Summarizing the above, the evaluation result using 
the simple specular effect is found by the following 
equation : 

I - quadBRDFpTM ( L)(L,V,N) + k • quadBRDF PT M (H )(L > V,N) n 

... (37) 

As explained above, the BRDF model of the present 
invention has an effect which cannot be obtained even if 
combining the effects possessed by conventional shading 
models . 

In the section on "correspondence with conventional 
models", the correspondence between the conventional 
shading algorithm Lafortune-BRDF or polynomial texture 
maps etc. and the BRDF model of the present invention is 
explained. When determining an appropriate parameter M 
according to the explanation here, equivalent effects to 
those by the conventional shading can be rendered by the 
BRDF model of the present invention. 

In color engineering, it is generally known that the 
effects of individual light may be added in order to 
superimpose the effects of different light. The BRDF 
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model of the present invention has linearity and enables 
superimposition of effects by adding different parameters 
M. 

However, no matter how the parameters M 
corresponding to the conventional shading algorithm are 
combined by weighted addition, the space of the 
parameters M of the BRDF model of the present invention 
cannot be completely filled. 

Accordingly, the BRDF model of the present invention 
has a new effect which does not exist in the conventional 
shading models. 

Further, a case where the algorithm of the present 
invention is designed based on the conventional circuit . 
will be considered. 

When comparing this with the general purpose 
operation unit, the operation unit of FIG. 9 (concretely 
FIG. 10) is specified so as to be able to efficiently 
process two operation modes peculiar to the BRDF of the 
present invention. Accordingly, more efficient processing 
can be carried out than the case where this is processed 
by a general purpose operation unit. 

Further, this is compared with a register combiner 
which is a special operation unit provided in the 
graphics processor of NVIDIA as a special operation unit. 
The configuration inside the register combiner more 
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detailed than FIG. 2 is not clear. However, even if 
considered with the degree of detail of FIG. 2, the 
inefficiency of a register combiner is clear. 

FIG. 15 shows the function of the first mode of FIG. 
5 9 realized by using the register combiner of FIG. 2. 

Further, FIG. 16 shows the function of the second 
mode of FIG. 9 realized by using the register combiner of 
FIG. 2. It is necessary to combine these three register 
combiners CMB1 to CMB3 in three stages in this case. 

10 Irrespective of the fact that the operations of the 

first two stages among three stages can be performed at 
the same time, the operations must be carried out divided 
into two steps. Therefore, the delay in the calculations 
is large. Further, in the first mode, the efficiency of 

15 utilization of the operation circuit in two register 
combiners among the three is halved. 

The efficiency of utilization of the operation 
circuit in one register combiner among the three is 
halved in the second mode. 

20 Accordingly, it is inefficient if the BRDF model of 

the present invention is processed by the register 
combiner as the prior art. 

As described above, as explained above, the present 
invention uses a generalized model of the shading models 

25 conventionally used for real time applications, so can 
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exhibit the effects equivalent to those by the 
conventional models. Further, it can exhibit unique 
effects provided by this model . 

From BRDF raw data found by observing real materials 
such as the clothing and skin or by simulation, the 
parameters for the BRDF model according to the present 
invention can be generated. Further, it is also possible 
to obtain the parameters of the BRDF according to the 
present invention using the parameters of conventional 
models such as polynomial texture maps as materials. 

The BRDF according to the present invention is 
obtained by modeling a BRDF by a quadratic-form matrix 
expression, so the model can be evaluated by just 
product-sum operations. If breaking down the BRDF 
5 according to the present invention to the form of 

polynomials comprised of sub matrixes, calculation of 
unrequired terms can be omitted. By this, the tradeoff 
between the expression power and the calculation 
efficiency can be adjusted. 
10 Further, since this is the model comprised of 

vectors and a matrix, a vector operation unit can be used 
for efficient operation. 

The form of expression is compact compared with 
conventional BRDF expression frequently using table 
25 reference. Further, since the tradeoff between the 



expression power and the calculation efficiency can be 
adjusted, processing by a further compact form of 
expression is possible. 

Due to this compactness, it is easy to combine this 
with texture mapping for obtaining a shift-variant format. 
The parameter M of the model may be stored in the table 
and looked up at the time of execution. 

Since the BRDF was modeled with a quadratic- form 
matrix expression, so long as hardware designed 
especially for a general vector and/or matrix operation 
is used, this model can be efficiently evaluated. The 
BRDF according to the present invention does not need a 
special circuit for evaluation of the model. However, if 
there is the already explained composition operation unit, 
the BRDF according to the present invention can be 
further efficiently processed. 

While the invention has been described with 
reference to specific embodiments chosen for purpose of 
illustration, it should be apparent that numerous 
, modifications could be made thereto by those skilled in 
the art without departing from the basic concept and 
scope of the invention. 



